Reinforcement learning control of robot manipulator
نویسندگان
چکیده
Since the establishment of robotics in industrial applications, robot programming involves therepetitive and time-consuming process manually specifying a fixed trajectory, which results machineidle time terms production necessity completely reprogramming for different tasks.The increasing number applications unstructured environments requires not only intelligent butalso reactive controllers, due to unpredictability environment safety measures respectively. This paper presents comparative analysis two classes Reinforcement Learning algorithms, value iteration (Q-Learning/DQN) policy (REINFORCE), applied discretized task positioning robotic manipulator an obstacle-filled simulated environment, with no previous knowledge obstacles’ positions or arm dynamics. The agent’s performance algorithm convergence are analyzed under reward functions on four increasingly complex test projects: 1-Degree Freedom (DOF) robot, 2-DOF Kuka KR16 Industrial random setpoint/obstacle placement. DQN presented significantly better reduced training across all projects third function generated agents both algorithms.
منابع مشابه
Reinforcement Learning for Multi - Linked Manipulator Control
We present an automatic trajectory planning and obstacle avoidance method for a multi-linked manipulator which uses position and velocity sensor information directly to produce the appropriate real-valued torques for each joint. The inputs are fed into a Cerebellar Model Arithmetic Computer (CMAC) [1] and in each state, the expected reward and torques for each joint are learnt through self-expe...
متن کاملLearning Control of Motion for Robot Manipulator
Given a desired output for a class of dynamical systems, certain kinds of iterative learning control are shown to be effective in the sense that the output converges to the desired one with repeating operations. One of those methods can be applied to a robot manipulator with high nonlinearities even though its physical parameters are not known. In this case, the velocity vector of the robot mot...
متن کاملReinforcement learning for robot control
Writing control code for mobile robots can be a very time-consuming process. Even for apparently simple tasks, it is often difficult to specify in detail how the robot should accomplish them. Robot control code is typically full of “magic numbers” that must be painstakingly set for each environment that the robot must operate in. The idea of having a robot learn how to accomplish a task, rather...
متن کاملLearning Inverse Dynamics for Robot Manipulator Control
Model-based control strategies for robot manipulators can present numerous performance advantages when an accurate model of the system dynamics is available. In practice, obtaining such a model is a challenging task which involves modeling such physical processes as friction, which may not be well understood and difficult to model. Furthermore, uncertainties in the physical parameters of a syst...
متن کاملHierarchical Reinforcement Learning in Robot Control
The use of reinforcement learning in robotics suffers greatly from the curse of dimensionality, stemming from the necessity of a high DOF in a robot to solve even the simplest tasks. This paper gives an overview over several attempts to decrease this problem using a hierarchical structure of reinforcement learning, an evaluation of the problems that arise with such approaches and possible solut...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Revista Brasileira de Computação Aplicada
سال: 2021
ISSN: ['2176-6649']
DOI: https://doi.org/10.5335/rbca.v13i3.12091